The ironic effect of significant results on the credibility of multiple-study articles.
نویسنده
چکیده
Cohen (1962) pointed out the importance of statistical power for psychology as a science, but statistical power of studies has not increased, while the number of studies in a single article has increased. It has been overlooked that multiple studies with modest power have a high probability of producing nonsignificant results because power decreases as a function of the number of statistical tests that are being conducted (Maxwell, 2004). The discrepancy between the expected number of significant results and the actual number of significant results in multiple-study articles undermines the credibility of the reported results, and it is likely that questionable research practices have contributed to the reporting of too many significant results (Sterling, 1959). The problem of low power in multiple-study articles is illustrated using Bem's (2011) article on extrasensory perception and Gailliot et al.'s (2007) article on glucose and self-regulation. I conclude with several recommendations that can increase the credibility of scientific evidence in psychological journals. One major recommendation is to pay more attention to the power of studies to produce positive results without the help of questionable research practices and to request that authors justify sample sizes with a priori predictions of effect sizes. It is also important to publish replication studies with nonsignificant results if these studies have high power to replicate a published finding.
منابع مشابه
Psychological Methods The Ironic Effect of Significant Results on the Credibility of Multiple-Study Articles
متن کامل
Interest rate and output gap: Does central bank credibility matter?
This paper studies the effects of central bank credibility on nominal interest rate and output gap on 17 inflation targeting (IT) developing countries using Instrument Variables (IV) over a period that spans 24 years (1996-2019). In the first stage, using new Keynesian model is obtained “Credibility loss” index to measure the importance of central bank past performance and its deviation from it...
متن کاملEffect of Progressive Muscle Relaxation on the outcomes of Multiple Sclerosis disease: A systematic review and meta-analysis
Introduction: Multiple sclerosis (MS) is an inflammatory disease, makes damage in central nervous system. Evidence showed Progressive Muscle Relaxation (PMR) technique is one of the non-pharmacological methods used to treat MS. The purpose of the study was to determining the effect of PMR on the MS's outcomes in published papers in the field. Method: This systematic and meta-analysis study we...
متن کاملEffects of Meat Consumption on Multiple Sclerosis: A Systematic Review and Meta-analysis
Backgrounds and Objectives: Multiple sclerosis is a common cause of neurological disabilities worldwide. Diet is a potential risk factor for the pathogenesis of multiple sclerosis and dietary intervention can be used as a prevention method for multiple sclerosis. The purpose of this study was the investigation of relationships between the type of meat consumed by the patients and multiple scle...
متن کاملفرا تحلیل پژوهش‌های حوزه علم‌سنجی بر اساس شیوع استفاده از پایگاه‌های اطلاعات علمی (موردمطالعه: پژوهش‌های داخلی)
: Scientometric research with the ability to assess scientific research and using multiple indicators in explaining capacities, scientific performance and technology in different dimensions has increased the attention of researchers.This study aims to meta-analysis the Iranian researches in scientometrics from the perspective of uses of scientific databases as data sources in this research fiel...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Psychological methods
دوره 17 4 شماره
صفحات -
تاریخ انتشار 2012